Description of changes

This moves the core code changes to initialize the processor decomposition from the mpi_scan branch in #3469 to b4b-dev. This removes some of the changes for memory checking and additional self testing as well as some of the additional timers that don't look useful now.

I created two previous branches before I created the process in #3665 where I worked out the details to NOT make this have too many commits and be hard to do. I also figured out how to remove merge commits as they need special handling, and usually aren't wanted in a case like this. Another way to do this would be to do this outside of git, which might have been similar length as the final version, but could've missed some important changes.

The actual code changes is that the task/thread decomposition determined at initialization was updated to be based on mpi_scan, rather than using a lot of complex custom code that was a much higher order based on the number of tasks. Methods to calculate the 2D global indicies for a point was added so that it could be displayed on endrun calls. processor_type and clump_type were moved towards an Object-Oriented (OO) programming style, more error checking added, including checking that the decomposion is correct, deallocates some initialization memory that isn't needed.

• decompMod -- New subroutines: decompmod_allocate_clumps, decompmod_allocate_gindex,,
  calc_ijindices_from_full_global_index
  New methods for processor_type: InitAllocate , calc_global_index_fromij,
  calc_globalxy_indices
  New method for clump_type: Init
  Add new data: nglob_x, nglob_y (global 2D indices)
  Add more error checking
  Add only_gridelll optional argument to get_proc_bounds (needed for calls used before the subgrid levels are set from calling decompInit_glcp)
• decompModInit -- Remove data no longer used, initialize procinfo data in procinfo%InitAllocate,
  clumps in clumps%Init, use mpi_scan rather than higher order method,
  add error checking, and asserts that decomposition is correct,
  reset clumps data to -1 for non-local processors to show that we don't need it (shows Dimension clumps object by clumps_proc rather than global nclumps #3466 can be done)
  add some timers
• lnd_set_decomp_and_domain -- add methods to deallocate memory when needed, change timers,
• Some broad changes: some endrun/shr_sys_abort calls changed to use the file, line format, initialize more pointers to null,

Changes of note for users:

• On endrun the 2D indices of the gridpoint are written out for endrun calls that send the point
• There is some checking that the PE decomposition is created correctly will now abort if it's wrong

Changes of note for developers:

• set_decomp_info in unittestSubGridMod uses more decompMod procedures
• Limitations of the decompMod testing are given in test_decompMod.pf

Specific notes

Contributors other than yourself, if any: John Dennis

CTSM Issues Fixed (include github issue #):
Fixes #3370
Fixes #3368
Fixes #3672
Some work on #3448
Some work on #3476

Are answers expected to change (and if so in what way)? No (the determination of the PE decomposition is identical as well)

Any User Interface Changes (namelist or namelist defaults changes)? No

Does this create a need to change or add documentation? Did you do so? No No

Changes to testing:

• endrun unit tests -- more tests for write_pt_context with the new write of the global 2D indices
• decompMod tests -- add more tests especially for the new calculation of 2D grid indices,
  use the set_decomp_info to allocate the PE decompostion,
  change test size so ni/nj isn't symmetrical to test that size checks are correct
• unittestSubGridMod -- add optional add_simple_patch argument to unittest_add_column,
  set more decompMod data in set_decomp_info,
  returns after endrun added for unittests
• many PF unit tests -- call the unittest_subgrid_teardown for tests that setup a PE decomposition

Testing performed, if any: ran standard testing
The mpi_scan testing branch has had all the test lists run for it: aux_clm, ctsm_sci, decomp_init, decomp_init_uhr, and fates